Search results for "rater training"
showing 5 items of 5 documents
Improvement of inter-rater reliability of PANSS items and subscales by a standardized rater training.
1998
The present evaluation focused on the inter-rater reliability of single items and subscales of the Positive and Negative Syndrome Scale (PANSS) before and after a standardized rater training. The results of two independent studies comprising n=23 (study I) and n=12 (study II) psychiatrists and videotaped interviews with schizophrenic patients were analysed. Chance-corrected coefficients of rating agreement with expert standards (weighted kappa) were computed for single items and subscales of the PANSS. The results clearly demonstrate the importance of rater trainings. After three training sessions, 90% of the PANSS items reached an acceptable level of reliability (kappa(w)>0.40) in both eva…
Standardized rater training for the Hamilton Depression Rating Scale (HAMD-17) in psychiatric novices.
2003
Abstract Background: Despite the long and widespread use of the Hamilton Depression Rating Scale (HAMD), standardized reliability studies in inexperienced raters are not available. Methods: Rater training was carried using three videotaped interviews with depressed patients in 21 psychiatric novices who had negligible previous experience with the HAMD. Chance-corrected coefficients of rating agreement with expert standards (weighted κ , ICC) were computed for single items and the total score of the HAMD. Results: The results demonstrate sufficiently high interrater reliability ( κ >0.60) for most of the HAMD items and the total score (ICC=0.57–0.73). Three standardized HAMD training session…
Evaluation of standardized rater training for the Positive and Negative Syndrome Scale (PANSS)
1998
The Positive and Negative Syndrome Scale (PANSS) is employed increasingly for the evaluation of therapeutic outcome in studies on schizophrenia. Rater training is important to improve the concordance and accuracy of ratings; however, there are no established guidelines for carrying out such training. We conducted rater training, under clinical conditions, of psychiatrists and clinical psychologists who were rather unfamiliar with the PANSS. Based on videotapes of PANSS interviews, all participants were trained during five successive standardized weekly sessions. The results were analyzed with respect to conventional criteria of concordance with standard expert ratings and interrater reliabi…
Evaluation eines standardisierten Trainings für die "Positive and Negative Syndrome Scale" (PANSS)
2000
Die vorliegende Arbeit umfasst 3 Untersuchungen zur Interrater-Reliabilitat der deutschen Version der “Positive and Negative Syndrome Scale for Schizophrenia” (PANSS). Zur Interrater-Reliabilitat und Trainierbarkeit der PANSS liegen im deutschen Sprachraum trotz der weiten Verbreitung der Skala bisher keine empirischen Daten vor. Bei 3 Stichproben mit insgesamt 47 Teilnehmern unterschiedlicher klinischer Erfahrung wurde ein standardisiertes PANSS-Rater-Training durchgefuhrt und evaluiert. Als Qualitatsmase fur das Training wurden die Ubereinstimmung mit einem Expertenstandard (K) und gewichtete Kappa-Koeffizienten (κw) berechnet. Als ein Hauptergebnis lasst sich feststellen, dass zur Erreic…
Puhetta arvioinnista : yleisten kielitutkintojen arvioijien käsityksiä arvioinnista
2016
This paper focuses on raters’ beliefs and views of assessment and the factors influencing their judgments and performance as raters in the National Certificates of Language Proficiency (NCLP) Finnish language test. Data were collected using semi-structured interviews (N=18) and content analysis was used to classify the responses. Findings suggest that raters’ experience and training have positive effects on rater performance and the use of assessment criteria. Experienced raters seem to be more familiar with different language proficiency levels and their view of language is more holistic today than during the first years of their rating experience. There are some external factors and lingu…